The Real Cost of LLM Inference: Memory Bandwidth, Not FLOPs
dev.to·1d·
Discuss: DEV
🗺️Region Inference
Flag this post
On Thread Synchronization : Part 1 - A deep dive into mutexes
sayujya-apte.github.io·19h·
Discuss: r/programming
🔗Concurrency Primitives
Flag this post
Unlocking Speed: Certified Symmetry Breaking with Auxiliary Variables
dev.to·1d·
Discuss: DEV
🧮Combinator Calculus
Flag this post
Perennial Technical Reading List
parallelprogrammer.substack.com·3d·
Discuss: Substack
📱Bytecode Design
Flag this post
Rust/Tokio vs. Go for a server side app that requires high performance/low latency.
reddit.com·7h·
Discuss: r/rust
🐹Goroutine Scheduling
Flag this post
Go Memory Model Deep Dive: What Every Go Developer Must Know – Serge Skoredin
skoredin.pro·1d·
Discuss: Hacker News
🧠Memory Models
Flag this post
September 2024 Progress in Guaranteed Safe AI
lesswrong.com·2d
🗺️Region Inference
Flag this post
Rust Smart Pointers: Safe Memory Management Without Garbage Collection
dev.to·15h·
Discuss: DEV
🔒Rust Borrowing
Flag this post
How LLM Inference Works
arpitbhayani.me·1d
🚀Tokenizer Performance
Flag this post
New Al Zimmermann's Programming Contests: Powerful Sums
azspcs.com·8h·
Discuss: Hacker News
🧩Constraint Solvers
Flag this post
Making SLH-DSA 10x-100x Faster
conduition.io·5h
🔗Hash Algorithms
Flag this post
Parallel C++ for Scientific Applications: Linear Algebra in C++
reddit.com·1d·
Discuss: r/cpp
🔀SIMD Programming
Flag this post
Indefiniteness makes lattice reduction easier
arxiv.org·2d
🔶Lattice Theory
Flag this post
An overview of memory management in Go (2021)
medium.com·12h·
Discuss: Hacker News
📚Stack Data Structures
Flag this post
Meditations on geometric packing
shvbsle.in·20h
🌊Effect Rows
Flag this post
Google's Nested Learning aims to stop LLMs from catastrophic forgetting
the-decoder.com·10h
🪜Recursive Descent
Flag this post
10000
jro.sg·17h
📦Executable Size
Flag this post
The Engineering Guide to Efficient LLM Inference: Metrics, Memory, and Mathematics
pub.towardsai.net·2d
🗺️Region Inference
Flag this post
Concept-Based Generic Programming -- Bjarne Stroustrup
isocpp.org·8h
🗂️Type Indexing
Flag this post